Systematic Observation of an Expert Driver's Gaze Strategy—An On-Road Case Study

In this paper we present and qualitatively analyze an expert driver’s gaze behavior in natural driving on a real road, with no specific experimental task or instruction. Previous eye tracking research on naturalistic tasks has revealed recurring patterns of gaze behavior that are surprisingly regular and repeatable. Lappi (2016) identified in the literature seven “qualitative laws of gaze behavior in the wild”: recurring patterns that tend to go together, the more so the more naturalistic the setting, all of them expected in extended sequences of fully naturalistic behavior. However, no study to date has observed all in a single experiment. Here, we wanted to do just that: present observations supporting all the “laws” in a single behavioral sequence by a single subject. We discuss the laws in terms of unresolved issues in driver modeling and open challenges for experimental and theoretical development.Peer reviewe

A new and general approach to signal denoising and eye movement classification based on segmented linear regression

We introduce a conceptually novel method for eye-movement signal analysis. The method is general in that it does not place severe restrictions on sampling frequency, measurement noise or subject behavior. Event identification is based on segmentation that simultaneously denoises the signal and determines event boundaries. The full gaze position time-series is segmented into an approximately optimal piecewise linear function in O(n) time. Gaze feature parameters for classification into fixations, saccades, smooth pursuits and post-saccadic oscillations are derived from human labeling in a data-driven manner. The range of oculomotor events identified and the powerful denoising performance make the method useable for both low-noise controlled laboratory settings and high-noise complex field experiments. This is desirable for harmonizing the gaze behavior (in the wild) and oculomotor event identification (in the laboratory) approaches to eye movement behavior. Denoising and classification performance are assessed using multiple datasets. Full open source implementation is included.Peer reviewe

Task-Difficulty Homeostasis in Car Following Models : Experimental Validation Using Self-Paced Visual Occlusion

Car following (CF) models used in traffic engineering are often criticized for not incorporating “human factors” well known to affect driving. Some recent work has addressed this by augmenting the CF models with the Task-Capability Interface (TCI) model, by dynamically changing driving parameters as function of driver capability. We examined assumptions of these models experimentally using a self-paced visual occlusion paradigm in a simulated car following task. The results show strong, approximately one-to-one, correspondence between occlusion duration and increase in time headway. The correspondence was found between subjects and within subjects, on aggregate and individual sample level. The long time scale aggregate results support TCI-CF models that assume a linear increase in time headway in response to increased distraction. The short time scale individual sample level results suggest that drivers also adapt their visual sampling in response to transient changes in time headway, a mechanism which isn’t incorporated in the current models.Peer reviewe

Child passengers and driver culpability in fatal crashes by driver gender

PMID: 26507116AbstractObjective: Studies based on accident statistics generally suggest that the presence of a passenger reduces adult drivers' accident risk. However, passengers have been reported to be a source of distraction in a remarkable portion of distraction related crashes. Although the effect of passengers on driving performance has been studied extensively, few studies have focused on how a child passenger affects the driver. A child in a car is a potential distractor for parents, especially for mothers of small children who often suffer from sleep deficit. The aim of this study was to examine how the presence of child passengers of different ages is associated with a higher driver culpability, which was expected due to child related distraction and fatigue. Methods: The analysis was based on the comprehensive data of fatal crashes studied in-depth by multidisciplinary road accident investigation teams in Finland during 1988–2012. Teams determine the primary party who had the most crucial effect on the origin of the event. We define the primary party as culpable and the others involved as non-culpable drivers. The culpability rate was defined as the percentage of culpable drivers and rates were compared for drivers with a child/teen passenger aged 0–17 year (N = 348), with an adult passenger without children (N = 324) and when driving alone (N = 579), grouped by child age and driver gender. Drivers with specific risk-related behavior (substantial speeding, driving when intoxicated, unbelted, or without license) were excluded from the analyses, in order to make the drivers with and without children comparable. Only drivers 26–47 years old were included, representing parents with children 0–9 years of age. Results: Male drivers were less often culpable with 0–17 year old passengers in the car than alone or with adults. This was not the case with female drivers. The gender difference in culpability was most marked with small children of 0–4 years. Female drivers' culpability rate with a 0–4 year old child passenger was higher but male drivers' lower as compared to drivers without passengers or with only adult passenger. Conclusion: The results indicate that female drivers are at higher risk of crashes than male drivers when driving with small children. Further research is needed to replicate this finding and to determine causal mechanisms.Peer reviewe

Effects of an active visuomotor steering task on covert attention

In complex dynamic tasks such as driving it is essential to be aware of potentially important targets in peripheral vision. While eye tracking methods in various driving tasks have provided much information about drivers’ gaze strategies, these methods only inform about overt attention and provide limited grounds to assess hypotheses concerning covert attention. We adapted the Posner cue paradigm to a dynamic steering task in a driving simulator. The participants were instructed to report the presence of peripheral targets while their gaze was fixed to the road. We aimed to see whether and how the active steering task and complex visual stimulus might affect directing covert attention to the visual periphery. In a control condition, the detection task was performed without a visual scene and active steering. Detection performance in bends was better in the control task compared to corresponding performance in the steering task, indicating that active steering and the complex visual scene affected the ability to distribute covert attention. Lower targets were discriminated slower than targets at the level of the fixation circle in both conditions. We did not observe higher discriminability for on-road targets. The results may be accounted for by either bottom-up optic flow biasing of attention, or top-down saccade planning.Peer reviewe

Action control, forward models and expected rewards : representations in reinforcement learning

Publisher Copyright: © 2021, The Author(s).The fundamental cognitive problem for active organisms is to decide what to do next in a changing environment. In this article, we analyze motor and action control in computational models that utilize reinforcement learning (RL) algorithms. In reinforcement learning, action control is governed by an action selection policy that maximizes the expected future reward in light of a predictive world model. In this paper we argue that RL provides a way to explicate the so-called action-oriented views of cognitive systems in representational terms.Peer reviewe

Visual anticipation of the future path : Predictive gaze and steering

Skillful behavior requires the anticipation of future action requirements. This is particularly true during high-speed locomotor steering where solely detecting and correcting current error is insufficient to produce smooth and accurate trajectories. Anticipating future steering requirements could be supported using "model-free" prospective signals from the scene ahead or might rely instead on model-based predictive control solutions. The present study generated conditions whereby the future steering trajectory was specified using a breadcrumb trail of waypoints, placed at regular intervals on the ground to create a predictable course (a repeated series of identical "S-bends"). The steering trajectories and gaze behavior relative to each waypoint were recorded for each participant (N = 16). To investigate the extent to which drivers predicted the location of future waypoints, "gaps" were included (20% of waypoints) whereby the next waypoint in the sequence did not appear. Gap location was varied relative to the S-bend inflection point to manipulate the chances that the next waypoint indicated a change in direction of the bend. Gaze patterns did indeed change according to gap location, suggesting that participants were sensitive to the underlying structure of the course and were predicting the future waypoint locations. The results demonstrate that gaze and steering both rely upon anticipation of the future path consistent with some form of internal model.Peer reviewe

Tracking an occluded visual target with sequences of saccades

Gaze behavior during visual tracking consists of a combination of pursuit and saccadic movements. When the tracked object is intermittently occluded, the role of smooth pursuit is reduced, with a corresponding increase in the role of saccades. However, studies of visual tracking during occlusion have focused only on the first few saccades, usually with occlusion periods of less than 1 second in duration. We investigated tracking on a circular trajectory with random occlusions and found that an occluded object can be tracked reliably for up to several seconds with mainly anticipatory saccades and very little smooth pursuit. Furthermore, we investigated the accumulation of uncertainty in prediction and found that prediction errors seem to accumulate faster when an absolute reference frame is not available during tracking. We suggest that the observed saccadic tracking reflects the use of a time-based internal estimate of object position that is anchored to the environment via fixations.Peer reviewe

Drivers use active gaze to monitor waypoints during automated driving

Peer reviewe

Driver Gaze Behavior Is Different in Normal Curve Driving and when Looking at the Tangent Point

Several steering models in the visual science literature attempt to capture the visual strategies in curve driving. Some of them are based on steering points on the future path (FP), others on tangent points (TP). It is, however, challenging to differentiate between the models’ predictions in real–world contexts. Analysis of optokinetic nystagmus (OKN) parameters is one useful measure, as the different strategies predict measurably different OKN patterns. Here, we directly test this prediction by asking drivers to either a) “drive as they normally would” or b) to “look at the TP”. The design of the experiment is similar to a previous study by Kandil et al., but uses more sophisticated methods of eye–movement analysis. We find that the eye-movement patterns in the “normal” condition are indeed markedly different from the “tp” condition, and consistent with drivers looking at waypoints on the future path. This is the case for both overall fixation distribution, as well as the more informative fixation–by–fixation analysis of OKN. We find that the horizontal gaze speed during OKN corresponds well to the quantitative prediction of the future path models. The results also definitively rule out the alternative explanation that the OKN is produced by an involuntary reflex even while the driver is “trying” to look at the TP. The results are discussed in terms of the sequential organization of curve driving.Peer reviewe